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ABSTRACT 

The purpose of this manual is to help Navy division 
officers, petty officers, and instructors build, use, and understand 
practical performance tests. Methods for testing men’s ability to- 
perform practical jobs are described in order to determine what they 
can actually do in meeting the requirements of their ratings, '* 
billets, or school training programs. Chapters are included on: (1) 

where and how to use performance tests advantageously, (2) deciding 
what to use for test tasks and an overview of the various types of 
performance tests, (3) "final product" performance tests, (4) 
"checklist" performance tests, (5) the construction and use of 
"examinee recorded" performance tests, and (6) how tests should be 
given and what to do with the test scores that have been obtained. 
The test construction chapters each contain an explanation of the 
type of test task to use, recording procedure, scoring methods, and 
suggestions on writing instructions for the examiner and examinees. 
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foreword 



The purpose of this manual is to help division officers, leading petty officers, and instructors build, 
use, and understand practical performance tests. The manual describes methods for testing-men's ability 
to perform practical jobs, in order to determine what they can actually do in meeting the requirements 
of their ratings, billets, or school training programs. J 

In writing this manual, it. was our aim to present in a simple way the steps to be followed in con-* 
structing performance tests, with the hope that good performance tests will be made and ubed for these 
purposes: 
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ite strengths and^weaknesses in training programs. 

To determine the qu^uficatidhs of men entering training schools. 

f WHAT IS A PERFORMANCE TEST? 

A performance test is a sample work situation in which the man being tested perYtwjris a practical 
task. The test requires him to demonstrate, how well he has mastered one or more of the skills required 
for £he actual performance of his job. A performance test may require the examinee to perform one of 
the tasks which he performs in his everyday routine, or it may involve a specially designed task which 
requires him to demonstrate a skill essential to his rate, billet, or school situation. 

Performance tests differ from written or identification tests in that* in the performance test, the 
examinee is actually required to do a job. Written and identification tests are designed to measure how 
much a man knows about his job and the equipment he works with, but do not reveal how he may per- 
form or use his tools when confronted with a job to actually do. . 

It is not intended that performance tests replace other methods of evaluation such as written tests, 
identification tests, or quarterly marks. They do, however, provide an important addition to these other 
methods. They should be used as part of the whole^scheme for evaluating a man, since they provide 
information that cannot be obtained in other ways. 
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HOW TO USE THIS MANUAL 



Chapter I of this mamiai tells where and how performance tests can be used to^dvantage. The 
chapters which follow it explain in detail how performance tests are built. 

Chapter II, “Test Tasks and Types of Tests," explains how to decide what to use for test tasks and 
gives an overview of the various types of performance .tests. This chapter will give you an idea of the. 
type of test that will fit your needs best. 

Chapter III covers “Final Product" performance tests. These are useful when you want to~use per- 
formance tests to test men on their ability to turn out an end product which adheres to prescribed dimen- 
sions or which is free from errors or defects. 

Chapter IV deals with “Check List" performance tests which are used when an examiner is available 
to actually watch the examinee perform a complex task. The latter part of this chapter covers the com- 



bination of final product and checP 



J. 



Chapter V explains the constructioH-<fn(l use of “Examinee Recorded" performance tests, which you 
will want to use* when you have a large number of men to test and only a few examiners to supervise their 
performance. They are especially valuable in measuring practical achievement in service schbols. 

Chapter VI describes how tests should be given and what to do with the test scores once they have 
bGen obtained. 

The three chapters on test construction each contain an explanation of the type of test task to use, 
the procedure for recording performance, the methods of scoring performance, and suggestions on 
•writing instructions for the examiner and examinees. 
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CHAPTER I 

Advantages and Uses of Performance Tests 

Probably the best way to give* the reader an understanding of performance testing is to show, in 
some detail, the advantages of this method of testing and tb show its many uses. 

ADVANTAGES OF PEk^ORMANCE TESTS 

1. They Are Work Samples. Performance tests are the best means available for measuri rig* men’s 
ability to perform their jobs. Other testing methods, such as written examinations, can tell you how 
much men know about their jobs or how familiar they are with equipment, but performance testing alone 
can tell you how well men can actually do the jobs required by their rates. ' 

It is not necessary Jto have a man perform all the jobs required by his rate to'get a good indication 
of his qualifications. Instead, his performance of a group of representative tasks (a work sample) will 
tell you how well he has mastered the basic skills of his rate, and thus give you an over-all picture of his 
ability to do his 40b. 

2. They Are Non-verbal. In those rates which call for mechanical or technical skills, a* man often 
learns more by doing than he does by reading 'or listening to lectures. The emphasis in these rates is less 
upon verbal ability and more upon a man’s ability to use his knowledge effectively in performing practical 




1 jobs. As a result, a man who is not able to express himsejf too well verbally can still learn the skills of 
his'rate and perform his job with the best of them. That is, learning to fulfill the duties of a mechanical 
* or technical rate does not require a man to be highly skilled in the use of language. # 



On the other hand, it is well known that some men can “talk” a good job but not perform it well 
when the time actually comes to do it. It is most important in such cases that the measurement of a 
man’s mastery of the'basicskills be based upon his ability to perform the real job rather than his ability 
to f tel) you how much he Knows about it. 

Therefore, because performance tests stress the doing of a job rather than the answering of questions 
concerning a job, they are useful far beyond the point whej*e other testing^methods leave off. 



3. They Are Objective. Because every man who takes the same performance test performs a specific 
task under exactiy the same conditions, and because every man who takes the same test is scored in 
exactly the same way no matter who scores him, performance tests give a fair, objective measure of the 
men’s mastery of the skills involved in doing the specific test task. If performance tests are used, it is 
not necessary to rely on a division officer's or leading petty officer's opiniomof what a^man can do. Instead, 
you have an objectiv<».jneasure of the map's actual ability to perform. By setting iip^tliese standard con- 
ditions of measurement, the possibility is reduced of a man being rated high or low because of the persona! 
opinions of his superior. Opinions of a map’s technical proficiency, a re often derived, at least partially, in 
terms of the man's personality. / 
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It is not intended, here, to indicate that technical proficiency is everything to the exclusion of a man's 
ability to be a leader and get along with people. Performance tests are measures of technical proficiency 
to be used in addition to measures of other characteristics which may be equally important. They are 
the best measures of technical proficiency and,^ such, do not pretend to measure other characteristics 
such as leadership. J 

4. They Are Easy to Administer. Personnel in Navy schools*and operating u ^helped in the prep- 
aration of this manual, and it was the finding of leading petty officers and school irtKi^uctors that per- 
formance tests not only were effective but also were easy to use.. This refers to the fact that the techniques 
of testing were relatively easy to master and the kinds of tests that gave the most objective measures 
of performance^made the least demands on the examiners' time. In some instances, it was even possible 
s to conduct a performance test in a regular watch standing situation. 

o 

USES OF PERFORMANCE TESTS 



The purposes for which performance tests are built will differ widely from one organization to an- 
other. Their uses will.be different in air squadrons, aboard ships, and in training schools. But their wide 
applicability in all these situations speaks for their value. You, as the user of performance tests, are in 
the best position to know how and where performance tests can help you most. 

Some of the more important uses of performance tests are listed below: ^ 

l.'They Help You Select and Assign Men. If you are receiving a new man or draft of men into your 
organization, you will want to assign them to billets according to their ability. Performance tests can tell. 
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you whether a man is qualified to stand .a Riven watch or perform it Riven duty. Or. they can tell you 
which of several men is the best qualified to do the task. r~p 

2. They Tell You Whim a Man Is Ready to Perform a Job. *Both aboard ship i./i the schools, it- 
is necessary to know when a man hits learned enouRh to be able to perform the tasks h^lis being taught 
to do. In the shipboard situation you may want to know if he’s ready to perform (he duties required for 
standiuR a watch, or you may want, to know if he ciin repair equipment or adjust it well en'ough to perform 
the tiisk by himself. Performance testiiiR can Rive you answers to these questions and tell you when a 
man is ready to perform a Riven job or to stand a watch. 



3. They Tell You Who Is Best Prepared for Special Joh Codes. In maiiv Navy units, afloat and ashore, 
there tire ’certain special Navy job codes assiRiicd to men who are capable of performing specialized 
duties. In these situations, performance tests can be used to indicate which of the men from a group o f . 
men or how many from a group are prepared to do these jobs and therefore should be assigned t,he&petial 
job codes. 
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1. They Tell You When a .Man Is Heady for Advancement in Hating. Advancement, in rating is based, 
among other tilings, on a man’s score on a competitive written examination and also upon his ability to 
perform t lit* practical factors of his rate. In the past the leading petty oflicer'or division otliccr often 
indicated, from his experience in watching the man perform his daily duties aboard the ship, whether or 
not he thought the man had the skill necessary for advancement. Performance testing offers an objective, 
standard method with which qualifications for advancement in rating can be measured and upofj^hjch 
recommendations for advancement ill rating can be based. Performance tests can tell you which men are 
most qualified for advancement or which have reached the minimum level of qualification for advance- 
ment. In this way performance tests can be used in the same manner written tests are now used. They 
would npt he a substitute for written tests, but a supplement, measuring practical ability in the same 
way written tests measure job knowledge. 

a. They Can Help You Establish the Qualifications of School Graduates. It is a common practice in 
the Navy to indicate how well a man has done in a school by reporting his class standing. Usually, this 
class standing is based on an average of the written tests and other measures of performance that have 
been made during the course of training. 

With the use of performance tests it is possible to measure how well the trainees can perform jobs 
requiring the basic skills taught in the schools. This information is not only of value to the people who 
administer U e schools hut also of value to the people who receive the school graduates and must assign 
them billets. * 



(i. They Can Indicate Progress Within. the School Curriculum. Since most Navy school curricula are 
divided into units or phases, it is necessary to determine when a mart has successfully completed a given 
phase. For example, under the Craftsman Method of teaching it is desirable to move the men along as 
fast as they can go, but at the same time to be sure that they have mastered one phase before they start 
another. Performance tests lend themselves to this kind of evaluation and provide important information 
for school administrators and instructors. . 

7. They Can Help You Spot Strengths and Weaknesses in Training/ It is often 'desirable to know 
whether a man or a group of men are strong in certain skills and weak in others. Thi.^proolem arir.es 
especially in shipboard training programs. For example, men are often assigned those duties which they 
perform hesbwilh the result that they get no training in other important required duties. If you are a 
training officer in anjuperating unit, you will want to know that your training program \£ covering those 
areas, of weakness which result from this specialization. 



ff you are an officer in charge of a Navy school, or the chief instructor, you’ll want to know whether 
or not all of the phases of training are being equally well taught. 



Performance testing, because it is a method of indicating how well a map can perform tasks requir- 
ing the basic skills of his rate, is a valuable tool for finding strengths and weaknesses. Either afloat^or 
ashore, with this information von can take corrective action to holster up a training program. 



8. They Can Pre-test Men Entering School. In many of our Navy schools or other training programs, 
new men often start out already able to do some of the important tasks that are to be taught in the 
training program. Under these circumstances, it is desirable to save the Navy’s time and to avoid dulling 
the interest of the men by permitting them to skip over the training on those tasks they can already 
perform. By the use of performance tests it is possible to measure the proficiency of these men before 

schooling begins and place them in the stage of training from which they can benefit most. 

■ / 

In general, performance tests can he used either to determine whether or not men meet the minimum 
requirements of performance on a given job, or to discriminate between men in their performance 
on that job. For example, if, in a radio school, a standard is set that requires all men to receive code at 
the rate of twenty words per minute, then, a good performance test can tell whether or not the students 
have met this minimum requirement. On the other hand, if you wish to assign scores to a. group of 
radiomen to indicate their relative ability to receive code, then a performance test can tell you which 
of t hose men is able to receive code fastest or with the fewest errors, which the nexj^md so forth on down. 

The actual use to which you put the test will depend on what you want to do with the results. If 
you want b> know whether or not a man is sujheiintly well qualified to he put up for advancement in 
rating, or if you want to know which man out of a group of men is most qualified to go up for advance- 
ment, then the performance test can he designed to fulfill either requirement. 
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Test Tasks and Types of Tests 






INTRODUCTION 

The tasks which are set up for use as performance tests will depend on what you want to do with 
the results. If you wish to know whether or not a man can stand a watch on a given piece of gear, it is 
only necessary to test him on that equipment. If you want to determine whether or not a man is qualified 
for advancement in rating, then the tasks should come from the practical factor requirements of the 
rate he is going up for. If you want to know which men are ready to begin a new phape in school, then 
the tasks for testing should come from the school curriculum. In short, the choice of test tas&s will depend 
on what you need to know about the examinee's ability. 



WHAT SHOULD THE EXAMINEE KNOW HOW TO DO? 



* 



The first step in building performance tests is to determine what the men you are going to test should 
know how to do. Depending upon your purposes in testing, you will want a list of rate, billet, or school 
requirements which will serve as a foundation for the second step, selecting and devising test tasks. If 
you only want to test th* examinees on an existing routine task that they should be able to perform, 
after you have completed the first and second steps, all you have to do is build a test around that task. 

If, however, you are testing men for advancement in rating, or achievement in school, the requirements J 
will include a list of tasks the men should be able to perform and a list of skills they should possess. / 

In this manual we will use the term “Task" to refer to the jobs that a man performs in his billets^ 
The term “Skill" will be used to refer to the underlying basic abilities that enable a man to perform 
these tasks. 

Here is a list of representative tasks and some of the skills which underlie them i ^ 



RATE 

Machinery Repairman 

Metalsmith 

Radioman 

Cook and Baker 

Quartermaster 

Electrician's Mate 

Yeoman 



TASK s 

Turning out a machine screw 
Making a locker 
Receiving a message 
Baking a pie 

Getting a fix by bearings 
Repairing a lighting circuit 
Preparing a letter 



SKILLS INVOLVED 

Using a lathe; blueprint. reading 

Welding; riveting; blueprint reading 

Code receiving; typing 

Mixing dough; using an oven 

Using pelorus; chart reading; 
plotting 

Circuit trouble shooting; using a 
megger; reading a wiring diagram 

Typing; using standard procedure 




TASKS REFLECT SKILLS 
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It is important that your list of requirements include skills, since a man with a good grasp of the 
basic skills of his rate will be able to apply them more efiiciently to a wider variety of specific tasks. The 
list should also include the more important tasks, so that no area of performance will be neglected in 
making up the performance test battery. \ 

Depending upon what you want to know about the examinees, you will need to consult one or more 
of the following sources of information to make up your list of tasks and skills: 

1 . NAVPERS 18068, The Manual of Qualifications for Advancement in Rating. This manual will 
give you ;i general listing of practical skills required for each rate and each pay grade in the Navy. It 
indicates what each man should know how to do to be qualified in the practical factors of a given rate. 
If you want to test men's qualifications for advancement in rating, then the “practical-factors" section 
of NAVPERS 18068 will be one of your principal sources of information. However, you should use other 
sources of information too. 

- 2. Experienced Personnel. Chief petty and warrant officers can give you important information con- 

cerning the tasks and skills needed to perform the duties of a rate. Moreover, if you wish to determine 
whether or not one man can fill a given billet, or if you are interested in determining which man out of a 
group of men can best fill a billet, then men with experience in that billet are your best source of infor- 
mation. For example, if you wish to make up a battery of tests for a yeoinarfs billet, then your best source 
of information is the Chief Yeoman. You can also go to division officers to get additional task and skill 
requirements. 

3. Training Curricula. To build performance tests for training school or on-the-job training evalua- 
tion, a list of tasks and skills can be obtained, by looking over the training curricula. The trainees should 
be tebted on the materials^taught. 

t 4 . Navy Training Cousscs. The training course manuals published by the Bureau of Personnel provide 
information concerning the practical duties of the various ratings. The test builder without experience in 
the rating for which he is building tests should consult the Navy Training Course manual for that rating. 

THE TEST TASKS 

After you have made up the list of tasks and skills, you will need to decide which ones to use for 
tests. In some instances you will be able to use routine daily tasks as they are for the test tasks. More 
often, nowever, you will either have to modify the actual task to fit your testing needs, or you will have 
to devise a test task. This latter will be necessary if you wish to measure ability in a broad area (for 
example, “Generators”) • or a general skill (for example, “Welding”). Devising the test task is part of 
performance test construction and is covered in each of the three chapters thajl^follow on ho\v to 
build tests. 

Whether you devise the test task, modify an existing task, or use the existing task as is /or testing 
purposes, there are certain considerations to be kept in mind when selecting test tasks: 

1. Representative Sample. If the list of tasks and skills is extensive, it is usually not feasible to test 
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the examinees on all of the tasks. Therefore, the test tasks' should cover a representative sample of the 
skill requirements. That is, there should be one test task covering each of the important skills, and there 
should be little overlap between the skills which are reflected by the tasks. 

2. Important Tasl^s. The test task itself should be important. It, or tasks like it, should be frequently" 
required in the performance of the billet or rate being testeef. 

3. Practicality. “Is the test task practical ?” Is it economical? If the examinee is to turn out a product, 
can you get the materials needed for the work? Does the task take too much time? Is the needed equip-, 
ment available? All of these practical considerations affect your choice of test tasks. 

4. Clumber of Men Required to Do the Test Task. The examinee should be able to perform the test 
task without the help of other"Ynen. Tasks which require the ; work of more than one man for their com- 
pletion should be avoided. The reason for this is that in these situations it is difficult to determine the 
adequacy of the examinee’s performance independently^of those helping him. 

5. Difficulty Level. The test task should not be so easy that all of the examinees Ciui perform it/ 
perfectly, yet it shduld not be so difficult that none of the examinees can perform it. The basic assumption 
of testing is that there are differences in men’s ability to perform. The test task should be just diflictilt 
enough to separate the poorer from the better men. 

Thus after you have made up. your list of tasks and skills, you screen the list to eliminate those 
which cannot be made into good test tasks. (Of course not all of these standards can always be met. 
However, an effort should be made to have your final test tasks conform to as many of these standards 
as possible.) You are now faced with the problem of selecting the type of performance tests to build. The 
remainder of this chapter describes the various types of performance tqsts and their uses. 

1 i> 

DECIDING WHAT TYPE OF TEST TO BUILD 

’i nere are three types of^erformance tests described in this manual,' The type to fise in any par- 
ticular instance will depend* on uje test task, on the administrative limitation of your own situation, and- 
on what you want to know about the examinees. Any of the three types can be built around some tasks, 
and the one to .select is the one which- will best tell you most about the examinees and still be adminis- 
tratively possible to use. In some cases two of the types can.be combined and built into a single test of a 
specific skill or group of skills..In other cases one type of test will fit a particular test task and your needs 
best. Sometimes, because of administrative problems (for example, the number of men to be tested) you 
are limited^to using a particular type of test. In this case, you must select or devise test tasks which fit 
that type of test. 

The goal of performance testing is to translate a man’s performance on a practical task into a score 
which reflects the quality of his performance. The record of performance is the means by which per- 
formance is translated into scores. This manual covers three basic ways of recording performance, and 
performance tests get their names from these three recording methods: Final Product, Check List, and 
Examinee Recorded. 

The record of performance for each man tested serves several purposes besides providing means for 
assigning scores: * 

1. It provides the information that stands for theTexaminee’s performance. 

2. It permits each man to be scored on the same basis and thus helps minimize instructor or super- 
visor bias or prejudice. * 

* * f 

3. It usually permits the examiners to score the tests at some convenient time after the test is, 
completed. 

An examination of each of the recording methods will show how each is used, where each is best 
used, and what some of the advantages and limitations of each type can be. With this information the 
test builder will know, what type of test to use in any situation he might face. 

THE FINAL PRODUCT 

The "Fins/l Product’* method of recording performance does not require an examiner to watch the 
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examinee perform each step in the test task. This method of recording applies to tests in which the 
examinee's performance results in something produced, or repaired. The result of the examinee’s per- 
formance is some sort of a product, which, by itself, is a record of what he did and how well he performed. 
The following are examples of what is meant by final product performance tests: 



1. Writing a letter 

2. Soldering a wire splice 

3. Welding a seam 

4. Filling in a requisition 

5. Repairing a circuit 



6. Making a log entry 

7. Building a tool box 

8. Fabricating an aluminum/ flush patch 

9. Making a fender 



If the skill around which you are building a test results in a final product such as those auove, and 
if you are not interested in how the examinee cares for tools, the procedure the examinee follows in doing 
the job, or whether the examinee adheres to prescribed safety precautions, the best approach to recording 
performance is through the final product itself. This approach reduces the length of the formal recording 
form and also reduces the possibility of examiner bias. An instruction sheet is made which clearly 
indicates to the examinee just what kind of a product he is expected to turn out For example, a final 
product test built around a man’s skill at operating a lathe might utilize a drawing such as that shown 
below with instructions covering the tools and machines to be used. 

% 




BUTTON FOR "C” CLAMP 
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The examinee 'performs on the lathe, turning out the product as specified. The product that he turns 
cut is a record of his performance, and it is evaluated in terms of the degree to which the specifications 
were met, together with as many other features of the work as properly reflect exr silence of performance, 

THE CHECK LIST * J 

The "Check List" is a series of statements, each of which defines a step in th^ test task. An examiner 
watches the examinee perform the test task and records bn the check list wh ^r or not the examinee 
successfully completes each step. 
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The check list type performance test lends itself best to the type of tasks that require a man to go 
through a series of steps in the proper sequence for successful completion. Examples of this kind of task 



are as follows: 




- 




1 . 


Starting an engine 


4. 


Putting a generator on the line 


2. 


Tuning a transmitter 


5. 


Operating a winch 


3. 


Paralleling alternators 


6. 


Lighting off a radar 



If diagnostic information (such as determining whether or not the examinee observes safety pre- 
cautions and takes care of the equipment and tools, or determining where he is weak and falls down on 
the job) is wanted, then the check list performance test is the one to use. An example of part of a check 
list recording form for a Transmitter Tuning Test appears below. Notice that the examiner's job is to 
observe the examinee and simply circle “1" or “0" (or in some cases “Yes" or “No"), according to whether 
or not each step was successfully completed. 






PART IV ANTENNA COUPLING: TUNE 

13. Increase antenna coupling for 70 m*. of P.A. plate current. 

14. Re-adjust P.A. tuning control J for minimum P.A. plate current. 

15. Rc-adjust antenna inductance for maximum P.A. plate current 

16. Re-adjust antenna capacitance for maximum P.A. plate current. 



PART V ANTENNA COUPLING: OPERATE 
1 0 \17. Shift Adjust-Tune-Opcrate switch to operate position. 

1 0 18. Re-adjust" P.A. tuning control J for minimum P.A. plate current. 

10 19. Rc-adjust antenna inductance for maximum P.A. plate current. 

1 0 20, Re-adjust antenna capacitance for maximum P.A. plate. current. 

1 0 21* Is P.A. plate tuning at a minimum with plate current at approximately 1CJ n.n. 






The 4< check dist" approach to recording performance can oe used to make a record of performance 
on any job which can be broken down into aperies of steps which must be completed successfully to do 
the job. Consequently, there are a great marty jobs in the Navy around which check lists can be con- 
structed and for which this approach is very convenient. However, there are some situations in which :se 
of a check list should be avoided. Generally speaking, the main disadvantage to the check list appro., ch 
is that it requires one examiner for each examinee. It also relies on the examiner’s ability to judge cor- 
rectly the performance of the examinee as it occurs. This is not always an easy job and introduces the 
possibility of examiner bias. Therefore, if the task lends itself to some other kind of recording, that is. 
either the examinee receded approach or the final product approach, then the check list nv ihoi! of 
recording probably shouifl be avoided. In some cases, the check list approach can be combined with the 
final product approach. 



COMBINING THE CHECK LIST AND THE FINAL PRODUCT APPROACH 

You may be interested in the manner in which^n examinee does his job, as well as t he* quality of 
the final- product he produces. In this case the check list approach to evaluation of performance in process 
may be combined with the final product approach of evaluating a man’s end product. For instance, suppose 
you wanted to test a man on his ability to fabricate an aluminum flush patch. You might be inter •■sled- 
in the procedure the man follows in doing the job, his method of handling tools, and the safety precau- 
tions he observes. At -he same time, you might be interested in the adherence of the final patch to 
prescribed dimensions ;.*id its freedom from defects. In this case you could construct a recording form 
composed of statements referring to the examinee's procedure as well as to statements referring to the 
freedom from defect of the final product the man produces. Sample statements from a combined approach 
are shown below: 
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TOOLS 

1. Alwaya uses back-up plate when center punching 1 

2. Does not elongate drill holes with drill 1 

3. Checks dividers when finished with measurement transference to make sure dividers did 

not slip - 1 

Etc, _ 



PROCEDURE ' 

12. Lays out and cuts out damaged area 1 

13. Rough files 1 

.4. Smooth files 1 

15. Lays out rivet pattern 1 

Etc. 

— ‘ S »! m* i 

SAFETY 

19. Uses goggles when drilling 1 

20. Does not aimvcompressed air hose at self or others * 1 

21. Places handle on file prior to using • 1 



FINAL PRODUCT 

26. Clearance between insertion and skin as specified (tolerance ± VitT) 3 



27. All comer radii % 




EXAMINEE RECORDED 

In many instances it is possible to assign the examinee a test task to perform, ana ne can make a 
record of his own performance on a sheet of paper. These are called “Examinee Recorded" performance 
tests. The examinee recorded performance test frequently is the best choice in situations where the 
examinee is required to mak<i measurements, to determine locations of casualties, to make interpretations 
of data, or to identify machinery and tools. The following examples may serve to illustrate these kinds 
of tasks. ( ‘ 

1. Measurements. A quartermaster taking a bearing with a pelorus; an electrician's mate measur- 
ing the resistance to ground in a cable. 

2. Locations. (Locating casualties in mechanical, electrical, or hydraulic systems.) An electronic 
technician locating a short in a radar set; an engineman locating a worn fuel injector. 

3. Interpretations. An ^ngineman interpreting the dial readings (on an instrument P ane 1 which 
might reflect normal or abnormal operating conditions) ; a metalsmith interpreting a blueprint. 

Tasks of these kinds result in the examinee recording, during his work*, some sort of information or 
an answer to some problem on a sheet of paper. He may record this information by making a check mark, 
encircling an alternative, or by writing in a numerical value or a descriptive word. The information 
recorded in this way serves as a record of the examinee's work and its correctness permits us to determine 
how well he did it. 

The recording form used by an examinee when taking a practical performance test is seldom like 
the conventional answer sheet used with written tests. Usually it must be specifically designed to fit the 
particular test task at hand. For this reason examinee performance test recording forms usually differ 
widely from one test to another, and no standard form can be specified. 

. The examinee recorded performance test is a useful measuring device when a large number of men 
must be tested in a short period of time. Several examinees can be tested by orte examiner. In addition, 
it is an objective measure of performance, since the examinee makes his own record of performance. 
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SCORING 



There is another consideration which affects the selection of the type of test to be built around a 
task. This is the problem of scoring practical performance. Generally speaking, the ways in which you 
can record performance on a test task are more limiting, as far as test construction is concerned, than 
ihe ways in which you can score the performance. Therefore, the first question to answer in selecting the 
type of test to use is, "How can I get a record of the men's performance?" But, at the same time, con- 
sideration miist be given to how that record of performance can be scored to reflect the men’s actual 
performance. 

4 It might appear that final product tests, because they automatically yield a record of performance, 

* are the easiest kind of performance test to build. This is not always true. In many cases, it is more difficult 

to derive a meaningful score from a final product than it is from other performance records. 

* ' ■>. * 

All three approaches to recording performance have advantages and disadvantages. Some of them 
have been pointed- out in this chapter, but you may run into others in building tests. The particular test 
/ task you select, and the situation in which the test must be administered, will determine in large part 

which recording and scoring method you select. 

SUMMARY 

Various ways of determining what to use for test tasks have been presented in this chapter. In 
addition, a brief introduction to the types of performance tests was given. The chapters which follow deal 
.in detail with the construction and use of these performance tests. Chapter III covers final product per- 
formance tests; Chapter IV deals with check list tests and combining final product tests with check list 
performance tests, while Chapter V describes the construction of examinee recorded tests. 
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CHAPTER III 

Final Product Performance Tests 

INTRODUCTION 

Chapter II pointed out the difference between testa of Final Products, Check List Tests, and Ex- 
aminee Recorded Tests. Here we consider final product tests only. 




THE PRODUCT STAiN DS AS A RECORD OF PERFORMANCE 

The general steps.. in building final product performance tests are as follows: 

1. Determine the type of product the examinees should turn out to demonstrate the skills you wish 
to test. (In the case of a specific task, this step is omitted, since you already know the nature of 
the product the examinees should turn out.) 

2. Devise methods of scoring the product. » 

3. Devise instructions for the examiner and the examinee. 

DEVISING THE PRODUCJ TO BE MADE 

The first step in constructing final product performance tests is to decide what kind of product the 
examinees are to make'fjepair, or maintain, to demonstrate their skills. The products the examinees turn 
out should: / 

1. Require a proad sample of the skill you wish to test. The mhn who has a better grasp of a skill 
will be ablbs to a pply^it to a greater variety of tasks. Consequently the test task should require 
as many aspects of the skill as possible. ■* 

2. Lend themselves to simple and objective methods of scoring. • ✓ 

OBTAINING A BROAD SAMPLE OF PERFORMANCE 

If you can devise a'test task that requires the skill necessary in performing a number of daily routine 
tasks, you will get a better indication of how well the man can fulfill the duties required by his billet. 

You can get a broad sampling of the examinees’ skill in two ways: 

1. Specify one product for the examinees to turn out which will require several aspects of the skill 
being tested. For example, to test men’s ability to use a lathe you might have them turn out a 
product whose construction requires turning, boring, facing, and screw cutting. In this way they 
would have to demonstrate a broad sample of their ability to use the lathe. 

2. Specify several products for the examinees to make, each of the products requiring a different 
aspect of the skill being tested. For example, instead of having the machinery repairmen demon- 
strate their ability to use the lathe by turning out one product, have them turn out four products. 
One of the products could call for them to demonstrate ability to use the lathe for turning, 
another product call for boring, the third for facing, and so on. 
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Regardless of whether one or several diff erent products .are to be made by the examinees, increasing 
the number of product samples that the examinees make increases the reliability of test scores. If, for 
example, men are *being tested on their ability to weld, and test scores are based on only one sample of 
each man's work, there is a chance that some of the poorer men will accidentally do well on the test and 
some of the better men may not perform up to their usual standards. If, however, scores are based on 
several samples of each man's work, the chances are better that the scores will reflect. each mart's ability 
properly. By increasing the number of samples on which you base test scores, the examinees gain an 
opportunity to settlr down and do the quality of work they customarily do, thus increasing the degree to 
which your scores reflect the facts. 

SCORING -FINAL PRODUCTS 

When specifying the product *the examinees are to make to demonstrate their skill, consideration 
should be given f o how that product can be scored. The product sometimes can be designed in such a . way 
that it can be scored objectively and conveniently. 

Different products must necessarily be scored in different ways. 

There are five ‘ways Anal products can be scored; some products can be scored by using only one of 

these methods and others by using several of them. 

% * 

1. Physical Measurement* In many instances the examinee will be given instructions to turn out a 
product to specifications. That is, he will be told to make something to given physical dimensions with a 
certain degree of tolerance. The products can then be scored on the basis of whether or not they meet 
the .specifications. One point is given for each dimension that is within the given tolerance limits. 

For example, machinery repairmen might be required to turn out the shaft pictured below. 
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Their performance could be scored on sixteen different measurements: eight diameters and eight lengths. 
One point could be given for each measurement that is within the given tolerance limits. 

It may be possible to score final products in terms of the degree to which their physical dimensions 
meet the specifications when "no tolerance" is specified. Suppose machinery repairmen were told to turn 
a shaft down, to two inches diameter, no tolerance. Those diameters which are within one ten-thousandth 
of two inches might be assigned a score of three, those within one five-thousandth a score of two, those 
within one-thousandth a score of one, and those diameters outside one-thousandth a score of zero. 

Two precautions should be pointed out here. First, if the man's products are to be scored in terms 
of the degree to which they meet the specifications (how close they are to perfect), the men should be 
told to make the product as close as they can to the specifications. They should be told that there are no 
tolerances. Second, precautions must be taken, when scoring products by measurements, to insure that 
the machines and tools the men use are equally precise. This can be done by having all the examinees 
use the sime tools and machines or by having each examinee turn out one product to the same specifica- 
tions using each of the machines and sets of tools. Each man’s score for that test task would be obtained 
by averaging the scores of all his products. In other words, each man should have the opportunity to use 
both the good. and poor equipment or else all men should use the same equipment. 

Another way of deriving scores on the basis of measurements of physical dimensions is to obtain 
the absolute sum of the errors or discrepancies from the specifications. By absolute is meant the value 
of the discrepancy disregarding whether the measured dimension is too large or too small. An example 
will make this clearer. Assume you were testing men's ability to use a shaper and had them turn out the 
notched block pictured below: 
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Perhaps to score these blocks you would measure the width (a) and depth (b) of the notch and the width 
(c), thickness (d), and length (e) of the block, making five measurements. You could derive a score by 
adding together the amount of discrepancy, found in each of these measures from their prescribed values, 
disregarding the dfrection of the discrepancy. 

2. Errors or Freedom from Defects. For certain types of products, 'physical measurements maybe 
combined with freedom from defects as a means of scoring. For example, if the products are such things 
as products turned on a lathe, a chair constructed by a carpenter, or a patch in an aircraft’s surface, their 
quality is determined in part by their freedom from defect. In these cases points can be subtracted from 
an examinee’s score for ‘each error treat is made. In some cases, errors may be used as the primary means 
of scoring. For example, if the products are such things as typewritten letters or sent or received mes- 
sages, their quality is determined in part by their freedom from errors. One point can be subtracted 
from a perfect score for each error that is made. 

In many instances, physical dimensions alone do not give a complete picture of the quality of a 
product. A gear, for example, may fit the dimensional specifications, yet have pits, flaws, or tool marks 
on some of its surfaces. It would not compare in quality to another gear of the same dimensions without 
these flaws. Points should be deducted for non-measurable errors such as these. The important point to 
remember is to score all errors on the same basis, deducting the same number of points for errors of equal 
seriousness, and to be sure that examiners look for the same errors in each final product; 

Sample items from an examiner's "reminder sheet” for scoring a plastic patch by aviation structural 
mechanics follow: 



* " *' -1 n 

20. NO bubbles in joint .- 3 

21. NO scratches or scars on plug 3 

22. NO dirt in joint 3 

23. NO spaces in joint 3 

r , — "p 



In some cases the final product will be such work as a sample entry made in a ship’s log, a letter 
written by a yeoman, a stub requisition filled in by a storekeeper, or a sample service record entry. An 
aid that has been found valuable for scoring end products such as filied-in forms is shown in Exhibit I. 
This aid was constructed in order to help examiners score data sheets which were filled in by Naval 
photographers. A portion of the examiner's check list is shown below: 






3. Locatjon-£**t sea” or fictitious location stated 

4. Ship— Name and number stated ‘ 

5. Date Shipped — Fictitious date stated; sequence of day, month, and year followed 

6. Photographer— Name and rate stated < 






1 

1 

1 

1 



<■> 
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PHOTOGRAPHER'S DATA SHEET 

UNtTVO STATU NAVAL PtWTOONAPMIC SI 

NAVADt-tOM {«fV. tt-41) 



XHIBIT I 

Scoring Aid Used in Seeding Photographer’s Data Sheets 

/T\ 

Ct ) V 





Crash ocoured because of engine failure on catapult ing. v 



ROLL AND SCEN 
No OR PACK AN 
NEGATIVE NO. 



Negative Noa. 

ems _/ x 





I4XJ crashed into eea off coos/ of Korea] 

USN^cllmbing from cockpit 
Kaoort Destroyer, U.S.S. SUITS (ID-120)/ launching snail boat 

to^plck up pilot. J\ 

Pilot LT J . DOK, USN aboard carrier reeel 
XQaL_carrler medical off leer, CIByD. MANT 
Brlal oblique: Port Side: U.S.Sy RANTOEEB^ 

• It itu de_ 50 Q .feet: *xpo eur e .. da t a^L 1/ 500 
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' KX III BIT II 

Scoring- Aid Used in Scoring Letter ^Writing Performance Test 






CV-15/J12 
Serial? 6 




U. S. S. RANDOLPH 
(CV-15) 




13 September 1952 



From: ^Commanding Officer, U.S.S. RANDOLPH (CV-15) 

To? — -—Naval Photographic Laboratory, Naval Air Station, Anacostia, D. C. 

Sub j: ^-Still Photographic N egatives; forwarding of 

Ref: (aJ-Hanual of Naval Photography, OPNAV INSTR 3150.6; 

^6j””Inci: (1) (SC) One (l) box of four (4) negatives 

1. In compliance with reference (a) enclosure (lj^is forwarded under sep- 
arate cover. ‘ 





A. B. SEE 
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In order for the examiner to score a data sheet,' the examiner simply checked for the presence of 
each of the bits of information called for in the examiner's check list. If the ^xaminer was hazy as 
what was meant by an item, say #4, all the examiner had to do was to look at #4 on the correctly filled 
in sheet (Exhibit I) and there he saw a correctly filled example/The same type of scoring aid was pro- 
vided to help examiners in scoring a covering letter, prepared by examinees, for the data sheets. Part of 
the examiner's check list for the covering letter is shown below while the sample letter that was provided 
is presented in Exhibit II. - 




29. Correct number of initiating source stated 



^30. Correct or fictitious file number stated 

31. Date stated in proper sequence 

32. Correct or fictitious serial number stated 





3. Scale of Model Products. There are certain types of final products which do not easily lend them- 
selves to scoring on the basis of physical measurements. It would be practically impossible, for example, 
to determine the quality of a solder or a wire splice without making very elaborate measurements. The 
quality of a soldered wire connection could be ‘determined by measuring the resistance it offers to the 
flow of electrical current. And, the quality of a wire splice could be determined by measuring its strength 
with a materials testing-machine. But these methods are generally administratively impractical. 

In a practical testing situation, products of this type can be scored by using a scale of model products. 
This scale consists of a series of actual products similar to the ones the examinees are required to make. 
To construct the scale, you rank'fne models according to their quality from the best to the poorest and 
assign them scores according to their rank. For example, to score solders, a scale of solders from excellent 
to poor could be set up like this: J . 



MODEL SOLDERS 




( 



UTaWa 1 



gizn 



Points 

4 

3 

2 

1 

0 



Description 

$ 

Excellent 

Good 

Average 

Poor 

Unsatisfactory 
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' Each examinee's test product is assigned the score of the product in the scale which it most closely 
resembles. 

The products used in the model scale can be obtained by having one experienced man turn out 
several products varying in quality or by accumulating samples of work of men who display the skill 
in varying degree. 

Ranking the products according to their quality in order to obtain a model products scale may require 
the judjgfthent of several experienced men. 

4. Does It Work? Many products cannot be scored by making measurements and looking for defects 
or by comparing them to a scale of model products; there are no graduated degrees of quality in final 
products of this sort. They either work or they do not, and it* is upon this basis that they must be 
scored. For example, if a gunner's mate assembles a gun as a test job, the final product either checks out 
properly or it does not; and it rs on this basis that the product must be scored. If an electrician's mate 
connects a motor to a controller, the motor either runs or it does not, and there are no other degrees of 
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quality which can be scored. Thus one point is assigned the product which works and zero to the product 
which does not work. 



There are many disac to a test in which all the examinees receive a score of either zero 



The problem of scoring products according to whether or not they work can he solved by increasing 
the number of products the examinees make, repair, or assemble to demonstrate one skill. For example, 
to test electrician’s mates’ ability to connect motors to controllers, they could be required to hook up the 
motors in a number of ways: as a differential compound motor, a.y& cumulative compound motor, etc. 
Each hook-up would then be scored according to whether or not tyc motor runs properly: one point for 
each correct hook-up. / 

Increasing the number of products the examinees are recfuired to turn out for one test has two 
important advantages. First, where the products are scored eid her one or zero according to whether or 
not they work, increasing the number of products to be turned out increases the total possible score and 
makes possible greater discrimination. 

Second, regardless of which method of scoring is used, increasing the number of products the ex- 
aminees must turn out increases the reliability of the test. In the case of the electrician’s controller- 
motor test, a man might get oi)e hook-up correct by chance but it is very unlikely that he would get ten 
hook-ups correct by chance. 

5. Time. The time taken to make the final product may be used as a partial measure of a man’s 
ability. Time as a measure, however, does not giye an indication of the quality of the product, and it 
should not be used as the sole measure of performance unless all the products are of essentially the same 
standard of quality. A man should not be given credit for rapid work if the work itself is not good. 

In some cases time must be used as a partial measure of performance. For example, a poor typist 
may type a letter with no errors if he is given all the time he wants. In this case time should be used as 
a measure of the proficiency of the man, or a time limit should bo set and scores should then be based 
on factors other than time. 

Time to make, repair, or assemble a product can be used as a measure of a man’s skill when* 

a. It is important to turn the product out rapidly when on the job. 

b. The product can be turned out perfectly by even poor operators when given all the time they want. 

c. Two or more examinees turned out products of equal quality but took substantially different 
amounts of time to do so. 

Test time limits are discussed more fully in Chapter VI. 
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DOES IT WORK? 






or one. From the test scores y8u can determine which men can do the test job (those receiving a score of 
one) and which men cannot (those receiving a score of zero). But, nothing can he determined concerning 
the differences in ability among Ihe men who made a score of one or those who made a score of zero. 
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SUMMARY OF SCORING PROCEDURES 

/ 

Final products may be scored in five ways: 

1. By measuring their physical dimensions 

2. By deducting points for error/ or defective work 

3. By comparing them to a scafc of model products 

4. By determining whet not they work 

5. By measuring the amount of time taken to make them 

a teat, each m.n”s Zrl ZuZZZZZdZ itZZZIyZ.Tth" “ 

INSTRUCTIONS FOR THE EXAMINEE 

ru. c eCtSo7^rtr: r* ™- 

tools, and equipment they have to do it with and the ^ th ,? y ar ® t0 do * what mat e r >als. 

should, therefore, contain the folloX SomatLn: 6 ^ ^ Examinees ’ instructions 

'' eV“r.'lt“' ibin ' the PUrP0Se °'. lhe tot - Fof “™» la * tee. «, youi .hi, it, te 

Z A eutement of -P-ifet.ions duscribin, the product the uxaminccs are to make. For example: 

* diir ": ent '‘ i ^ - 1 ”- 1 

is often the clearest description and qhnnlH Ka ‘ a , " e P rCK ^ uct the examinees are to make 
or schematic does not sTpX so much C* 1 * (Pr ° Vided the drawi "* 

tolerances to be observed, these should be clearly indicated heCOmeS to ° eaay >' If there are 

3. A list of the tools and machines the examinees may use in performing the test job. For example: 

‘TOOLS AND MATERIALS 

A. Knee and column universal milling machine 

B. Swivel vise and wrench 

C. Milling machine arbor and spacers * 

D. Cutter 

E. Rack gear blank 

F. Vernier gear tooth calipers 

G. Parallels 

t 

H. Dial indicator/ 1 

4. The time limits, if an. For oxampio : ••You have forty ,40) mihu.es to perform thi. Job •• 

• “*** * «- -n the 

that each man fully understands the task J. re Z bc ,Ure 

The examinees' instructions should be read nlnnrl k v ttw> < t j . . / 
the examinees should have copies of their own to look^t closelv SET 8 *? ^ ^ at the ™ mC t,mc 
examinee instructions for the task involving the filling r ». ‘ hefore nnd dur,n * the test. Sample 
a rough covering letter are shown in Exhibit 111 f * biographer's Data Sheet an.l composing 
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INSTRUCTIONS FOR THE EXAMINER 

The instructions for the examiner should contain all of the information which the examinees* instruc- 
tions contain, and, in addition, they should con^in the following: f * 

1. A description of how* the final product is to' be scored; the specifications for the products; the 

tolerance limits, the number of points to be deducted for errors; and how time scores are to be 
used (if any). ' 

• . — \ ,J : 

2. A description of how the testing area should be set up (This last pointis covered more fully iri 

Chapter VI.) . ^ ; 

Sample examiner instructions covering the filling in^of the Photographer's Data Sheet 
posing a rough covering letter are shown in Exhibit IV. ' ' ~< 



, EXHIBIT III 

PERFORMANCE EXAMINATION 
RECORDS AND REPORTS , ■ 

SHIPMENT OF MATERIAL TO FILM LIBRARY 
EXAMINEE INSTRUCTION 

TASK — This is a test of your ability to prepare the forms required to cover making of motion or 
still picture material to the official U. S. Navy Photographic film library at the Naval Photo- 
graphic Center, Anacostia, D. C. The material that you are to mail is described below. Your 
task is to fill out the Photographer's Data Sheet and to compose a rough letter of transmittal, 
both of which arc needed to implement this shipment. 

MATERIAL TO MAIL 

You arc the photographer aboard the U.S.S. RANDOLPH (CV-15). You have shot in black 
and white the following sequence of photographs and are mailing the negatives to the film 
■^library: 

Negative 1 shows an F4U which on catapulting has engine failure and has fallen into 
the sea. The pilot is shown climbing from the cockpit. 

Negative 2 shows an escort destroyer, the U.S.S. SMITH (DD-120), launching^ small 
boat to pick up the pilot. 

Negative 3 shows the pilot back on the carrier after rescue, receiving medical treatment 
from the medical officer. 

In addition you arc including in the shipment a fourth negative. J 

Negative 4 shows an aerial oblique of your carrier. 

Any information which you might need but which is not supplied is to be filled in fictitiously. 
For instance, since you do not know when the photos were made, you may fill in any date as 
the date of the event... 

All of your shots have been made with a K»20 Camera. 

SCORING — You will be scored on the QUALITY of the finished forms. 

\ 

TEST MATERIAL— The following have been provided for your use: 

1. Pencil. 

2. Pen. N 

3. Carbon Paper. \ \ 

4. “Photographer’s Data Sheets*' .(NAVAER - 1086). 

6. 8 Vi" x 11%** paper. 

6. Photography Technical Bulletin — .Cumulative Edition. 

7. Photo Lab Index. 

8. Photography (NAVPERS 10371). 

9. Photography (NAVPERS 10372). 

10. Paper clips. 

EXAMINEE’S NOTES 

1. This is a timed test. 

2. Use the white 8%" x 11 %** paper for ail wort other than work which you would ordinsrily 
do on the “Photographer’s Data Sheets.’* 

3. Be sure to supply all necessary data, using fetitious data wh p 

TIME — Time starts as soon as you understand what you arc to dt 
that you know what your task is and are ready to start. j 

Be sure you understand what you arc to do before you start. Have you any questions? 



Tc necessary. 

Slid •report to the examiner 
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EXHIBIT IV 

PERFORMANCE EXAMINATION 
RECORDS AND REPORTS 
SHIPMENT OP MATERIAL TO FILM LIBRARY 
EXAMINER INSTRUCTIONS 

t t • 

TASK — This U * teat of the. examinee's ability to prepare the forma neccaaary for shipping: motion 
.and still picture material to the Central files of official U. S. Naval Phptogrnphy at the Naval 
Photographic Center, Anacostia, D. C. 

GENERAL DIRECTIONS 
TO EXAMINER 

1. Read very carefully and thoroughly the “Examinee .Instructions." Be sure you understand 
the test and the method for administering it before attempting to give it to the examinee. 

2. Assign the examinee to a desk in a quiet, ventilated room and provide him with the test 
material. 

3. Have the examinee read the “Examinee Instructions." Ask him if he has any questions. If 
he has a question, reread to him that part of his instructions which answers his question. 
Make sure that the examinee understands what he is to do before he starts. Supply no 
accessory information. Remember, this is a test situation, not a training one. 

SCORING — You should receive each of the following products from the examinee: 

1. Photographer's Data Sheet. 

2. Letter of Transmittal. 

Each of these is to be scored separately on the appended scoring sheets. Also appended is a 
sample data sheet, correctly filled in, and a sample covering letter. REFER TO THESE 
SAMPLES WHEN SCORING. DO NOT ATTEMPT TO SCORE THIS TEST WITHOUT THE 
USE OF THESE SAMPLES. If you think that the examinee should receive credit on an item, 
do nothing to the number which appears after that item. If the examinee is not to receive 
credit on an item cross out or X over the number appearing after that item. On completion of 
the scoring, add up the non-crossed-out numbers and enter the total in the space provided. 

TIME — Time is counted as soon as the examinee understands what he is to do and is told to 
start. For credit on the time item, the examinee must finish in 45 minutes or less. If he docs 
net finish in 45 minutes or less, allow him to finish. He receives no credit, on the time item, 
however, unless he completes the data sheets and covering letter in 45 minutes or less. 

■WigBBWHBW mm l BSP! 






SUMMARY 

A wide variety of the practical skills which Navy men must possess can be tested using final product 
performance tests. Final product tests are ones in which the examinee’s performance results in a product 
which can be scored. 

A ■ *** _. 

The steps in constructing final product tests are as follows: 

1 # Determine the type of product the examinees should make, repair, assemble, or maintain to 
demonstrate the skill you wish to test. The product or products should require a broad sample 
of the skill yon wi-h to test. This can be done by having the examinees turn out one product 
which requires many of the aspects of the skill, or by having them turn out several products 
each of which requires one aspect of the skill. 



2. Determine how the product or products can be scored. There are five ways to score final products- 
by measuring physical dimensions, by comparing them to a scale of model products, by seeing 
if they work, by counting the number of errors, and bv measuring the amount of time'it takes 
to make them. 



3. Write instructions for examinees and for examiners.- 
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CHAPTER IV 



Check List Performance Tests 

INTRODUCTION 

The check list performance test is used when you want to observe a man while he actually performs 
the test task. As a testing method it is simple and has a wide variety of uses. If you wish to test a man's 
ability to stand a watch on a given piece of equipment, you can use a check list and record each operation 
he performs. Or if you want to determine how well a man performs a task in which he makes something, 
you can watch him do the task, record and score his performance with a check list, and also score the 
final product^* produces. 




PERFORMANCE CHECK / 

Using the check list, not only can you score how well the examinee performs the test task, but you 
can also score how well he cares for tools and equipment and observes safety precautions while he 
performs. 

With many tasks, the check list is the only method of testing that can be used. In these tasks no 
product is made or no information is gathered and hence the other types of tests covered in this manual 
are not applicable. 



The tasks which are best suited to the check list generally involve what are called procedural skills, 
which are the sort of skills involved in performing the steps of a task in the proper sequence and usually 
in accordance with prescribed rules for safety and care of the equipment. A few examples of procedural 
type tasks are given below: ^ 
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1. Starting an engine 

2. Tuning a transmitter 

3. Changing the plugs in an aircraft engine 

4. Paralleling alternators^ 

The only wayfciat you- can properly evaluate how well a man can perform tasks of this type is to 
watch him actually go through each step in the job in sequence. An examiner is required to watch the 
examinee perform the job and mark the check list according to whether or not each step is successfully 
and properly completed. 



Putting a generator on the line 
Loading an aerial camera 

7. Field stripping a 20 mm. cannon 

8. Operating the ship's boat 



In many instances it is desirable to use the check list approach even though a final product results 
irom the examinee’s work. The check list is used in' these cases because it reveals more about perform- 
ance than an evaluation of the final product alone. For example, suppose the task were that of having a 
boatswain take the ship’s boat to a dock, pick up some stores, and return to the ship. In a sense the final 
product of his performance is, whether or not he got back to the ship with both the boat and stores in 
proper condition. So if one were to evaluate the final product of his performance that would be the only 
thing there would be to go on. 
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But there might be wide differences in the skill which various boatswains would show in accom- 
plishing this same task. One boatswain might give poor orders to the engineman in getting away from 
the side of the ship, might have to reorient himself halfway out in the stream after having taken a series 
of courses which were not very appropriate, might violate several rules of the road enroute, might make 
a poor approach to the dock on landing, and make an equal number of errors on the return trip. Another 
boatswain might produce the same end result (same final product) but might execute all of the proceed- 
ings necessary for getting the boat to its destination and back again with a great deal of skill and dispatch. 

The development of check lists for tasks from which no final product evolves is discussed in the 
first part of this chapter, while check list appraisal of procedure plus an evaluation of a man’s final 
product is discussed in the latter part. 

j If you find, upon examining the list of skills and tasks around which you wish to construct per- 
formance tests, that one or more of them lends itself to the procedural check list approach to testing, 
the general test construction steps to be followed are these: 

1. Devise a recording form which will contain all the important and essential steps required in per- 
forming the test task, the safety precautions the examinee should observe while performing, and 
the equipment care he should demonstrate while working. 

2. Devise instructions for the examinee. These prescribe the task the examinee is to perform. 

3. Devise instructions for the examiner. 

4. Devise a method of assigning a score value to each step in the test task and to other features of 
performance such as safety precautions and care of tools and equipment. 

DEVELOPING THE RECORDING FORM 

The steps described in the sections which follow make Up the “task analysis’* which is performed 
in designing the recording form. Although scoring procedural check list tests is taken up in more detail 
later in this chapter, the features of performance that should be scored must be given consideration prior 
to the actual making up of the. recording form. 

Step 1. WhaVfeatures of performance will be scored: In general, the features of performance which 
can be scored wherKthe check list test is used are as follows: 

Completion of each step in the test task. 

Care of equipment and tools. 

Regard for safety rules. 

Time. 

The final product. 

The recording form is made up with these* sc orable features in mind, so that items will be selected which 
can be scored in these terms. 

Step 2. Rule a piece of paper as shown in Exhibit I. At the top of the paper write the name of the 
test task. Under this write as column headlines the features you are going to score. Your paper will then 
look similar to ‘that shown below. 



EXHIBIT V 

TASK ANALYSIS— CHEMICAL MIXING 

PROCKDUllEf CARE & USE OF TOOLS SAFETY PRECAUTIONS 



Step 3. List the steps in the test task. If you are thoroughly familiar with the test task, and can 
correctly perform it yourself, list the steps to be performed in detail. If you are not completely familiar 
with the task, there are other ways you can got the steps. 






a. List the steps an experienced and highly competent man goes through in performing the opera- 
tion. This can be done by having such a person perform the task while you watch. Whenever 
questions arise he can explain to you exact\y what he is doing and why. 

b. Consult manufacturer’s instruction book for the equipment concerned. One of the chapters in 
such a book is entitled “Operation" and this will indicate how, according to the manufacturer, 
the equipment should be operated. 

In practice it would be desirable for the test constructor to follow all of these methods in determin- 
ing the steps in the job. In this way he can be assured that he has not omitted any essential step and 
that he has not included any step that is not important -to completion of the task. 

Write in the steps of the test task under the "Procedure" column. List the tools and equipment 
that are used under "Care and Use of Tools." When you have done this your "task analysis" sheet will 
look like the one in Exhibit VI. This form was used in the development of a, test of chemical mixing for 
aerial photographers. 
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EXHIBIT VI I 


TASK 


ANALYSIS — CHEMICAL MIXING 8 


PROCEDURE 


CARE & USE OF TOOLS SAFETY PRECAUTIONS 8 


Draw appropriate chemicals. 


Dichromate, acid. ■ 


Weigh out 3 ounce dichro- 
mate. 


Scale, paper. . 3 


Wash equipment 


1 


Add dichromate to small 
quantity of water. 


1 


Stir while adding. 


1 


Completely dissolve dichro- 
mate. 


34 ounce graduate, stirring H 

rod, tank. H 


Add water to make one 
quart. 


1 


Measure 12 ounces acid. 


I 


Add acid to dichromate solu- 
tion 


I 


Fill quart container. 


Quart container. 1 


Label (Name of solution, 
who mixed, date mixed). 


Labela. B 


Wipe down pans and work 
area. 


Sponge. H 


Replace weights and mate- 
> u- — -riahr™ 


1 


Wash tank, graduate, etc. 


1 



Next read over your list of tools and materials; ask yourself what the proper method of using each 
tool and material you listed is. Write in this information. In the case of chemical mixing your work sheet 
would now look like Exhibit VII. 
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EXHIBIT VII 



TASK ANALYSIS — CHEMICAL MIXING 

CARE A USE OF TOOLS SAFETY PRECAUTIONS 



PROCEDURE 



Draw appropriate chemicals. Dichromate, acid. 



Weigh out 3 ounces dichro- 
mate. 



Wash equipment. 

Add dichromate to small 
quantity of water. 

Stir while adding. 

Completely dissolve dichro- 
mate. 



to make one 



Add water 
quart. 

Measure 12 ounces acid. 

Add acid to dichromate solu- 
tion 

Fill quart container. 

Label (Name of solution, 
who mixed, date mixed). 

Wipe down pans and work 
area. 

Replace weights and mate- 
rials. 

Wash tank, graduate, etc. 



Scale — Weights on right, 
chemicals on left. 

Check for “truenesa" prior to 
use. Center counterweights. 

Evenly distribute chemicals 
ovdf pan. 

Pajier — Use clean paper on 
both pans. 

Rinse all equipment prior to 
use. 

34 ounce graduate, stirring 

rod - \ A 

Tank. 

\ 



Quart container. 



Labels. 

Sponge, 



Weights placed in proper 
places. 



Step-4. Ust the safety precautions involved in doing the job. Having listed the procedure and tools 
and, materials, you look over the lists and determine what' safety precautions are involved. The question 
to ask as you read down each step of the procedure (and at the same time over the tools) is: “What can 
be done at this point that is unsafe?" List the safety precautions as they appear. 

For the chemical mixing test, the appearance of the work sheet now would look like this: 



EXHIBIT VIII 



TASK ANALYSIS — CHEMICAL MIXING 

CARE A USE OF TOOLS SAFETY PRECAUTIONS 



PROCEDURE 



Draw appropriate chemicals. Dichromate, acid. 



Weigh out 3 ounces dichro- 
mate. 



Scale — Weights on right, 
chemicals on left. 



Never leave uncapped. 

Resto immediately ' after 
use. 

Nev«r pour acid in drain. 
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Check for “truenesa” prior to 
use. Center counterweights. 
Evenly distribute chemicals 
over pan. 






Paper — Use clean paper on 
both pans. 


Discard paper immediately 
after use. 


Wash equipment. 

Add bichromate to small 
quantity of water.' 


Rinse all equipment prior to 
use. 

34 ourice graduate. 


Use only cold water. 

i 


Stir whil^ adding. 


Stirring rod. 


* 


Completely dissolve dichro- 
matc. 


Tank. 




Add water to make 1 quart. 
Measure 12 ounces acid. 


Quart container. 


Add acid at side of dichro* 
mate solution. 


Add acid to dichromate solu- 
tion. ‘ 




Stir rapidly when adding 
acid. 


Fill quart container. 




~ Add acid to dichromate, not 
reverse. 


Labels (Name of solution, 
who mixed, date mixed). 


Labels. 


• 


Wipe down pans and work 
area. 


Sponge. 




Replace weights and mate- 
rials. 


Weights placed in proper 
places. » 




Wash tank, graduate, etc. 







Sometimes there is more than one way of doin^ a tAsk. If this is’the case, itfis necessary to list the 
two (or more) alternatives. For instance, when grinding a drill, some people corqjrtptely •grind one flute 
and then start on the other. On the other hand; some people alternate grinding from one flute to the 
other until they are completely satisfied with the job. Both procedures are acceptable and both would 
be listed in the task analysis. 



REVIEW BY OTHERS 

Once the task analysis is complete, have it reviewed by others who are proficient in the task’a^alyz.ed 
and ask them to review it for accuracy. Ask the reviewers: “Is this how you would do this job?” J “What 
other safety precautions are there?” “What other care of equipment characteristics does the good, 
careful worker show?”, etc. 



ITEM WRITING 

The final recording form is constructed direetlytfrom the task analyst sheet and upon the recording 
form should appear some statement relating to each duty listed in the task analysis. The final recording 
form consists of a series of statements (items). An item is essentially a clear, simple, guidepost state- 
ment telling the examiner what to look for and score while giving the test. 
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GOOD AND POOR ITEMS 



An item is a statement which describes a step the examinee should perform when doing the test or 
what the examiner should look for while recording the examinee’s perlormance. As with everything 
else, there are good and .poor items. In general, you can tell if you have a good item if you ask yourself 
these questions as you write. 



1. Is the item specific? Does it refer to observable aspects of performance? Does it tell the examiner 
exactly what to look for? In the case of “precision of the final product,” does it state what tolerance 
to allow? 



Q 

;hinf 



Examples: 

Good item — keeps clothing buttoned while working on plane. 

Poor item — Clothing worn in safe manner. » 

Good item — Pats dry. Does not rub. 

Poor item — Dries area or dries in proper manner. 

Good item — Clearance as specified on schematic (tolerance' ± Vo/')- 
Poor item — Clearance as specified on schematic.! 



2. Is the item worded simply? Does it contain unclear, unfamiliar, or difficult terms? What else 
could the item mean to the examiner? Could unintended emphasis on a word or a phrase change the 
meaning? Is the item in any way apt to! be misunderstood? 



Examples: 

Good item — Never touches lens with fingers. 

, Poor item — Refrains from digital or continuous contact with lens. 



3. Is the item in the correct working order? Does it appear in the same sequence in which it appeared 
in the task analysis!? In the case of alternative working procedures and tools, are all alternatives included 
on the final recording form? * 



4. Are all scorable aspects scored? What have I omitted? What else do people usually do wrong 
when doing this job? What other safety precautions are there, and which ones are usually ignored? 



THE FINAL RECORDING FORM 



On the basis of the task analysis for chemical mixing, the record sheet shown in Exhibit IX was 
prepared. , 
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